Unreasonable Effectivness of Deep Learning
نویسنده
چکیده
We show how well known rules of back propagation arise from a weighted combination of finite automata. By redefining a finite automata as a predictor we combine the set of all k-state finite automata using a weighted majority algorithm. This aggregated prediction algorithm can be simplified using symmetry, and we prove the equivalence of an algorithm that does this. We demonstrate that this algorithm is equivalent to a form of a back propagation acting in a completely connected k-node neural network. Thus the use of the weighted majority algorithm allows a bound on the general performance of deep learning approaches to prediction via known results from online statistics. The presented framework opens more detailed questions about network topology; it is a bridge to the well studied techniques of semigroup theory and applying these techniques to answer what specific network topologies are capable of predicting. This informs both the design of artificial networks and the exploration of neuroscience models.
منابع مشابه
The Relationship of Study and Learning approaches with Students’ Academic Achievement in Rafsanjan University of Medical Sciences
Introduction: Most experts consider learning approach as the fundamental basis of learning dividing it into two parts of deep learning approach and surface learning approach. This is an endeavor to investigate the relationship between learning and study approaches with academic achievement among students in Rafsanjan University of Medical Sciences. Methods: This descriptive cross-sectional stu...
متن کاملA Hybrid Optimization Algorithm for Learning Deep Models
Deep learning is one of the subsets of machine learning that is widely used in Artificial Intelligence (AI) field such as natural language processing and machine vision. The learning algorithms require optimization in multiple aspects. Generally, model-based inferences need to solve an optimized problem. In deep learning, the most important problem that can be solved by optimization is neural n...
متن کاملA Hybrid Optimization Algorithm for Learning Deep Models
Deep learning is one of the subsets of machine learning that is widely used in Artificial Intelligence (AI) field such as natural language processing and machine vision. The learning algorithms require optimization in multiple aspects. Generally, model-based inferences need to solve an optimized problem. In deep learning, the most important problem that can be solved by optimization is neural n...
متن کاملتأثیر آموزش راهبردهای خود تنظیمی بر رویکردهای یادگیری دانش آموزان اول دبیرستان
Abstract The present study was conducted to determine the effect of learning self-regulation strategies on surface, deep and strategic learning approaches of high school first grade female students in Yazd. The study method was pre-test and post-test design. For this purpose, a sample size of 57 subjects was selected by multistage cluster sampling method among high school first grade female ...
متن کاملGlobal Warming: New Frontier of Research Deep Learning- Age of Distributed Green Smart Microgrid
The exponential increase in carbon-dioxide resulting Global Warming would make the planet earth to become inhabitable in many parts of the world with ensuing mass starvation. The rise of digital technology all over the world fundamentally have changed the lives of humans. The emerging technology of the Internet of Things, IoT, machine learning, data mining, biotechnology, biometric, and deep le...
متن کامل